Estimating the noise components of a signal during periods of speech activity

ABSTRACT

Enhanced estimation of the noise component of a signal is accomplished by using a plurality of filters. Each filter provides an estimate of a minimum sample in a sample set that includes a plurality of signal samples. A comparator, coupled to the plurality of filters, successively compares the estimates among the plurality of filters, and selects the signal estimate having the lowest magnitude. The selected signal estimate represents an enhanced estimate of the noise component of the signal.

RELATED APPLICATION

This application is a continuation of U.S. Patent application Ser. No.09/107,919 filed on Jun. 30, 1998 the contents of which are incorporatedby reference herein in full as if set forth in full herein.

FIELD OF THE INVENTION

The invention relates generally to communications systems, and morespecifically to techniques for estimating the noise components of asignal.

BACKGROUND OF THE INVENTION

Many present-day communication systems provide unpleasant speech qualityin the presence of background noise. These communications systems arenot able to adequately distinguish background noise from voiceinformation, with the result that the system attempts to transmit bothvoice and noise over a communications link. At the other end of thecommunications link, this transmitted noise degrades the quality of thereceived voice signal. Such degradations are particularly serious in thecontext of wireless communications systems. For example, considerdigital cellular telephone transceivers which incorporate speech codersso as to reduce the bit rate that must be transmitted over thecommunications channel. Although bit rate reduction is desirable in thatit permits the capacity of wireless communication systems to beincreased, it renders the communications system increasingly moresusceptible to speech quality degradations in the presence of noise.

As a practical matter, it is difficult or impossible to determine theactual waveform of background noise. Therefore, in order to reduce theextent to which background noise degrades speech quality, it isnecessary to develop an estimate of the characteristics of this noise.The characteristics of noise can be expressed in terms of a plurality ofnoise parameters. For purposes of improving speech quality, an estimateof noise parameters will suffice.

The primary focus of prior art noise estimation techniques has been onthe estimation of noise parameters during speech pauses. Indeed, it ismuch more difficult to estimate noise parameters in the presence ofspeech activity and, as such, the prior art includes fewer examples oftechniques for addressing this more complex problem. One approach forestimating noise parameters is disclosed in U.S. Pat. No. 4,185,168issued to D. Graupe and G. D. Causey on Jan. 22, 1980 and entitled,“Method and Means for Adaptively Filtering Near-Stationary Noise From anInformation Bearing Signal”. This patent describes a noise estimatorthat detects the minima of a plurality of successively smoothed inputmagnitude values. The smallest minimum out of a predefined number ofminima is used as an estimate for the spectral magnitude of the noise. Amajor drawback of the Graupe-Causey noise estimator is the lack of anadaptation mechanism to prevent the noise estimate from jumping uprapidly. These rapid jumps may be a problem in cases where the estimatorattempts to follow speech instead of noise. Moreover, the presence ofsuch a mechanism is important in cases where no spectral minima ofspeech occur during the period over which spectral minima are evaluated.

A noise estimator that eliminates the drawback described in thepreceding paragraph is disclosed in a dissertation entitled,“Contributions to Noise Suppression in Monophonic Speech Signals,” byWalter Etter, Ph.D. Thesis, ETH Zurich, 1993, available from the SwissFederal Institute of Technology. This estimator, referred to as the “TwoTime Parameter” (TTP) noise estimator, provides control over the attacktime of the noise estimate through the use of a rise time limitationfilter. Since the duration between spectral minima in speech follows astatistical pattern, no precise upper length for this duration can bespecified. Therefore, a minimum tracker may provide, for example, a 95%certainty that it tracks speech minima. For the remaining 5%, the noiseestimator would immediately attempt to follow high-level speech unlessan appropriate mechanism, such as a rise time limitation filter, were inplace to prevent immediate attacks and the consequent following ofspeech instead of noise.

Consider a more advanced TTP (two time parameter) noise estimator, whichuses a minimum rise (MR) filter consisting of a minimum hold filterfollowed by a rise time limitation filter, where each of these filtersis defined in terms of two time parameters related to the occurrence ofphonemic minima in the speech signal. A significant drawback of the MRfilter is its computational complexity. More specifically, the filterrequires a step of successively selecting the smallest sample from asequence of M samples, which is very demanding from a computationalpoint of view. This complexity translates into higher product costs,requiring the use of a relatively elaborate digital signal processor,thereby reducing battery life in portable applications. Since, ingeneral, a noise estimator is only part of an entire system, it isallocated only a small portion of the total signal processing powerprovided by a digital signal processor (DSP) integrated circuit. For theforegoing reasons, it is not economically feasible to implement an MRfilter using present-day hardware. What is needed is a noise estimationtechnique that approximates the performance of an MR filter, while atthe same time providing reduced computational complexity.

The prior art presents yet another shortcoming that relates to theaccuracy of the noise estimate obtained from a signal. In the prior art,when noise and speech have similar magnitudes but substantially oppositephases, the noise and the speech cancel out, resulting in the occurrenceof one or more minima in a set of samples. In the frequency domain, thisset of samples may represent spectral magnitudes of a signal for whichthe noise component is to be estimated. By contrast, in the time domain,the sample set may represent short term average (or RMS) values of thesignal. The noise estimation process is unable to distinguish minimaattributable to phase cancellations from other minima that areattributable to the occurrence of phonemic minima in speech. However,the noise components of a signal can be estimated accurately during theoccurrence of phonemic minima, but not during the aforementioned phasecancellations. The prior art approach mistakes phase cancellation minimafor phonemic minima, resulting in an inaccurate estimate of noise. Notethat prior art approaches, such as the previous two noise estimatorsdescribed above, have addressed the phase cancellation problem in anad-hoc way using a low pass pre-filter. Such a filter merely smoothesout short minima across the set of samples instead of eliminating theseminima from the samples. In addition, a low pass pre-filter leads to abias in the noise estimate, and it can be difficult or impossible toprovide compensation for this bias. The prior art has failed to realizethat this pre-filter plays an essential role in estimating noise from aspeech signal, and that the use of a simple low pass filter is not anadequate approach. Also, the prior art fails to provide an analysis ofthis phase cancellation problem in order to define an appropriate filtercharacteristic of the pre-filter.

SUMMARY OF THE INVENTION

According to a first embodiment of the invention, enhanced estimation ofthe noise component of a signal is accomplished by undertaking aprefiltering of a sample set prior to noise estimation. The prefilteringdiscards any sample minima in the sample set that are shorter than aspecified duration so as to provide a prefiltered set of samples. Forfrequency domain operation, this sample set is in the form of samplesrepresenting spectral magnitudes of the signal. For time domainoperation, the sample set represents short term average (or RMS) valuesof the signal. The prefiltering may be performed, for example, byholding a maximum sample value from a set of samples for the specifiedduration. The prefiltering process may be implemented using a short-termmaximum hold filter, thereby providing considerable computationalexpediency over the short-term smoothing prefilters used in the priorart. Nevertheless, one primary advantage of the prefiltering process ofthe invention is that the prefiltered set of samples provides a noiseestimate of enhanced accuracy relative to the prior art. In the priorart, when noise and speech have similar magnitudes but substantiallyopposite phases, the noise and the speech cancel out, resulting in theoccurrence of one or more minima in the set of samples. The noiseestimation process is unable to distinguish these minima, attributableto phase cancellations, from other minima that are attributable to theoccurrence of phonemic minima in speech. However, the noise componentsof a signal can be estimated accurately during the occurrence ofphonemic minima, but not during the aforementioned phase cancellations.The prior art approach mistakes phase cancellation minima for phonemicminima, resulting in an inaccurate estimate of noise. Pursuant to thetechniques of the invention, the prefiltering process discards minima inthe set of samples that are the result of phase cancellations.Therefore, any minima that remain in the prefiltered set of samples aredue to phonemic minima, and not due to phase cancellation between speechand noise. In this manner, the invention provides a prefiltered set ofsamples from which an enhanced estimate of noise parameters may beobtained.

According to a second embodiment of the invention, enhanced estimationof the noise component of a signal is accomplished by undertaking aplurality of independent filterings of the signal, each filteringproviding an estimate of a smallest sample in a sample set. Forfrequency domain operation, this sample set is in the form of samplesrepresenting spectral magnitudes of the signal. For time domainoperation, the sample set represents short term average (or RMS) valuesof the signal. Advantageously, the signal estimate having the smallestvalue represents an enhanced estimate of the noise component. Thisapproach provides reduced computational complexity relative to the priorart technique of determining the actual value of the smallest sample. Inthe prior art, a mathematical minimum operator must be employed todetermine the actual sample value, and this operation is quiteresource-intensive relative to the process of estimation.

A third embodiment of the invention combines the techniques of the firstand second embodiments. Enhanced estimation of the noise component of asignal is accomplished by undertaking a prefiltering of signal samplesprior to noise estimation. The prefiltering discards any sample minimashorter than a specified duration from the signal samples so as toprovide a prefiltered set of signal samples. Next, a plurality ofindependent filterings of the signal are performed, each filteringproviding an estimate of a smallest sample in a sample set.Advantageously, the signal estimate having the smallest value representsan enhanced estimate of the noise component.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a flowchart setting forth an operational sequence performed bya prior art minimum rise (MR) filter design.

FIG. 2 is a hardware block diagram of a phonemic minima-tracking (PMT)noise estimator constructed in accordance with the principles of thefirst embodiment of the invention.

FIG. 3 is a flowchart setting forth an operational sequence performed bya delayed rise (DR) filter design which may be used to perform thesecond embodiment of the invention.

FIG. 4 is a hardware block diagram showing an illustrative embodiment ofa pseudo phonemic minima tracking (PPMT) noise estimator including apseudo minimum rise (PMR) filter constructed in accordance with theprinciples of the first and second embodiments of the invention.

FIG. 5 is a flowchart setting forth the sequence of operations performedby the pseudo minimum rise (PMR) filter used in FIG. 4.

FIG. 6 is a hardware block diagram showing an illustrative embodiment ofa noise estimator using a respective PPMT filter for each of acorresponding plurality of frequency bands.

FIG. 7 is a hardware block diagram showing an illustrative embodiment ofa time domain noise power estimator constructed in accordance with theprinciples of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Prior art noise estimation techniques use a minimum rise (MR) filterwhich is defined herein as including a minimum hold filter followed by arise time limitation filter. The minimum hold filter must repeatedlyidentify a minimum sample value from an incoming sample set, therebyplacing heavy demands on computational resources. More specifically, theminimum-hold filter is called upon to perform an operation thatsuccessively selects the smallest (lowest-magnitude) sample from asequence of M samples. It would be desirable to eliminate the need forthis minimum-hold operation without significantly degrading the accuracyof the noise estimate.

FIG. 1 is a flowchart setting forth an operational sequence performed byprior art minimum rise (MR) filter designs. The program commences atblock 101 where a new sample value, denoted as x(i), is read. Next, atblock 103, a tentative noise estimate, Y_(o), is calculated, which isequal to the minimum sample value in the sample set of x(i), x(i−1),x(i−2) . . . x(i−M+1), where i is an integer representing a time indexand M is the total number of samples in the sample set. At block 105, atest is performed to ascertain whether or not the tentative noiseestimate, Y₀ is less than a noise start level E. If so, the noiseestimate Y is set to E, and program control advances to block 115, to bedescribed below. The negative branch from block 105 leads to block 107where a test is performed to determine whether or not the product of arise time constant r and the previous noise estimate Y is less than thetentative noise estimate Y. If not, the program advances to block 113,and if so, the program advances to block 111.

The affirmative branch from block 107 leads to block 111 where the noiseestimate (y) is set to the product of r times Y. The program advances toblock 115 where Y is used as the noise estimate, and the program thenloops back to block 101. Note that block 115 is also reached afterexecution of block 113. The negative branch from block 107 leads toblock 113 where the noise estimate (y) is set to the tentative noiseestimate (Y₀). The program advances to block 115 and then loops back toblock 101. The dotted lines in FIG. 1 enclose an operational sequencethat defines a rise-time-limitation filter.

FIG. 2 is a hardware block diagram of a phonemic minima-tracking (PMT)noise estimator constructed in accordance with the principles of thefirst embodiment of the invention. This embodiment provides enhancedestimation of the noise component of a signal by undertaking aprefiltering of signal samples prior to noise estimation. Theprefiltering discards any sample minima shorter than a specifiedduration from the signal samples so as to provide a prefiltered set ofsignal samples. In the example of FIG. 2, this prefiltering is performedby holding a maximum sample value from a set of signal samples for thespecified duration. Holding the maximum sample value for a specifiedduration accounts for the fact that noise should be estimated at minimumsample values representing phonemic minima, and not at minimum samplevalues caused by noise canceling out speech. Such cancellation may occurwhen noise and speech have substantially opposite phases but similarmagnitudes. In FIG. 2, the prefiltering is performed by a short-termmaximum hold filter 701 which provides considerable computationalexpediency over the short-term smoothing filter used in the prior art.

The noise estimator of FIG. 2 includes three cascaded nonlinear filtersin the form of the short-term maximum-hold filter 701, a long-termminimum-hold filter 703, and a rise-time limitation filter 705 Onelinear filter, aliasing filter 707, may be employed to filter the outputof the rise-time limitation filter 705. The PMT noise estimator differsfrom prior art systems in terms of the type of pre-filter used. In priorart systems, a low pass smoothing filter is used as a pre-filter tosmooth out fluctuations in the input. However, careful analysis of thepurpose of the pre-filter shows that its function is to block minimashorter than 10 20 ms while providing complete transparency for minimaof longer duration. Such a sharp transition from non-transparency totransparency cannot be achieved by the low pass smoothing filter used inthe prior art. Due to the inherent characteristics of a linear low passsmoothing filter, the transition phase from non-transparency totransparency is spread out in time. By contrast, the short-term maximumhold filter 701 provides a sharp transition, avoiding missed detection(the case where a phonemic minimum is not detected when such a minimumactually occurred), and false detection (the case where a phonemicminimum is detected when no phonemic minimum is actually present).Moreover, the short-term maximum-hold filter is employed to account forthe fact that the noise should be sampled when noise and speech havesimilar phases, such that their respective magnitudes add up instead ofcanceling out.

A short-term maximum-hold filter 701 of length L holds the maximumsample value from a sample set of L samples and can be expressedmathematically asx(i)=max(v(i),v(i−1), . . . ,v(i−L +1)),where v(i) denotes the filter input and x(i) denotes the filter output.This filter eliminates low-level “outlying” samples so as to address thepossibility that noise and speech can momentarily cancel out each otherif they are of similar magnitudes but opposite in phase. Suchcancellation could occur over one frequency band, across severalfrequency bands, or even throughout the entire frequency band of thesignal. Ideally, the composite magnitude, i.e., the magnitude of speechplus noise, is only evaluated when both noise and speech are in phase,at which instance the composite magnitude reaches its maximum.Consequently, short-term maxima are most relevant. The short-termmaximum-hold filter ensures that the noise component is only trackedduring true phonemic minima. Since phonemic minima typically last longerthan 20 ms, the time-constant of the maximum-hold filter is set toτ_(L)≈20 ms. Accordingly, the maximum hold filter 701 prevents minimashorter than 20 ms from reaching the input of long-term minimum holdfilter 703. It should be noted that, in general, a short-term maximumhold filter provides considerable computational expediency over theprior art short-term smoothing filter. For this reason, a trueshort-term maximum hold filter 701 can be employed in FIG. 2 withoutadding much.

Assuming that the sequence v(i) is sampled at a sampling frequency ƒv,then the required length L of short-term maximum hold filter 701 isdetermined byL=τ_(L)·ƒv·For a typical sampling frequency ƒv of 200 Hz, corresponding to a blocklength of 5 ms, the required length L of the filter is 4. This providesa filter of relatively small size, resulting in a small computationalload. It may be noted that, instead of using a short-term maximum-holdfilter 701 in the configuration of FIG. 2, any of a number of otherfilters could be employed to achieve the purpose of blocking out shortminima. A median filter provides performance very similar to that of themaximum-hold filter, at the expense of higher computational complexity.A low pass (short-term smoothing) filter, as used in the prior art,although computationally the least intensive, provides degradedperformance since such a filter does not satisfy the design criteriadiscussed above (i.e., substantially filtering out short minima). Alsonote that the maximum-hold filter is preferred over an ordinaryexponentially decaying peak-tracker realized by a first order recursivefilter since such a filter does not have a finite impulse response.

Through utilization of a short-term maximum hold filter, the PMT noiseestimator of FIG. 2 provides a considerably more accurate noise estimaterelative to the prior-art TTP noise estimator. However, thecomputational complexity of these two approaches (prior art and use of ashort-term maximum hold filter) is still about the same. To reducecomputational complexity, in accordance with an embodiment of theinvention, a pseudo phonemic minima-tracking (PPMT) noise estimator maybe utilized according to the second embodiment of the invention.

According to the second embodiment of the invention, enhanced estimationof the noise component of a signal is accomplished by undertaking aplurality of independent filterings of the signal, each filteringproviding an estimate of a smallest sample in a sample set. One or moreof these independent filterings may be implemented using the proceduralsequence shown in FIG. 2. Note that, for frequency domain operation,this sample set is in the form of samples representing spectralmagnitudes, whereas, for time domain operation, the sample setrepresents short term average (or RMS) values of a signal.Advantageously, the signal estimate having the smallest value representsan enhanced estimate of the noise component. This approach providesreduced computational complexity relative to the prior art technique ofdetermining the actual value of the smallest sample. In the prior art, amathematical minimum operator must be employed to determine the actualsample value, and this operation is quite resource-intensive relative tothe process of estimation.

In developing a PPMT noise estimator for implementing the filteringprocess described in the preceding paragraph, the inventors haverealized that the minimum rise (MR) filter of FIG. 1 is not the onlytype of filter that is capable of tracking minimum values in samplesets. Another type of filter which has minimum tracking properties isthe Delayed Rise (DR) filter shown in FIG. 2. A DR filter does not, ingeneral, provide a value for the true minimum sample in a sample set.Rather, the DR filter merely provides an estimate of the minimum sample.Since both the DR filter and the MR filter utilize arise-time-limitation filter, this filter need not be considered forpurposes of comparing the performance of the DR filter to that of the MRfilter. In the case where no rise-time-limitation filter is employed, aDR filter of length M provides an estimate for the minimum value thatoccurs in a sample set consisting only of the previous M signal samplesx(i), x(i−1) . . . x(i−M+1). This estimate lies within a well-definedrange having an upper bound and a lower bound. The lower bound of theoutput of the DR filter coincides with the true minimum value in thesample set of M samples, and this relationship is mathematically denotedby the expression:min(x(i), x(i−1), . . . , x(i−M+1)),where x(i) represents the signal fed to the input of the DR filter. Ifthe filter reaches the lower bound, it performs as a true minimum-holdfilter. The upper bound, that is, the maximum value that the DR filterwill provide for a given input sequence, equals the most recent samplevalue x(i). The output y(i) of the filter can therefore be characterizedby the following bounds:min(x(i), x(i−1), . . . , x(i−M+1))≦y(i)≦x(i)

It is important to note that a single DR filter only provides anapproximation of the smallest sample, whereas the minimum rise filterused in prior art designs identifies the smallest sample.

FIG. 3 is a flowchart setting forth an operational sequence performed byan illustrative delayed-rise (DR) filter design. The operationalsequence commences at block 200, where the algorithm is initialized,i.e., an initial noise estimate (Y) and a minimum-hold counter (C) isset. At block 201, a new sample input value (X) is read. Next, at block203, a test is performed to ascertain whether or not the noise estimate(Y) is less than a noise start level (E). If so, Y is set to E (block219), a counter (C) is set to a minimum hold constant (M) (block 221),and Y is used as the final noise estimate. The noise start level E maybe set equal to the inherent noise level of the system. The mechanism ofa minimum noise level ensures that the noise estimate does not fallbelow an unrealistic low value, in which case, it could take therise-time filter a long period of time to recover.

The negative branch from block 203, representing the regular or “normal”operating mode, leads to block 205 where a test is performed toascertain whether or not X is greater than Y If not, the DR filter isreset by setting Y to X, and by setting C to zero (block 217). Y is thenused as the final noise estimate (block 215). The affirmative branchfrom block 205 leads to block 207 where a test is performed to determinewhether or not C is greater than M If not, C is set to C'1 (block 211),and Y is used as the final noise estimate (block 215). The affirmativebranch from block 207 leads to block 209 where Y is set to the productof r times Y, r representing a rise time constant. Y is then used as thefinal noise estimate (block 215). Block 226 encloses the sequence ofoperations which are used to implement the delayed-rise filter.

As stated above, it is important to note that a single DR filter (FIG.3) only provides an approximation of the smallest sample, whereas theminimum rise filter used in prior art designs determines the smallestsample. However, by placing a set of DR filters in parallel, one canapproximate the performance of a minimum-rise filter. As the number ofparallel-connected DR filters is increased, the performance of thisparallel combination more closely approximates the performance of aminimum-rise filter. Therefore, any arbitrarily-specified level ofperformance may be achieved by connecting the requisite number of DRfilters in parallel. If a total of M DR filters are connected inparallel, the performance of such a combination is exactly identical tothe performance of the minimum-hold filter. This relationship ismathematically denoted as:min(x(i),x(i−1), . . . ,x(i−M+1))=y(i)That is, the upper and lower bounds are identical and equal to the trueminimum. The preceding mathematical identity is achieved by resettingone of the M parallel-connected DR filters once every sample cycle, andthen by using a comparator to select the output of the DR filter havingthe lowest-magnitude output sample. If it is desired to lower thecomplexity of the overall system, the number of parallel-connected DRfilters is kept small. A configuration with any number ofparallel-connected DR filters having outputs coupled to a comparator asdescribed above is hereinafter referred to as pseudo minimum rise (PMR)filter.

FIG. 4 is a hardware block diagram showing an illustrative embodiment ofa pseudo phonemic minima tracking (PPMT) noise estimator constructed inaccordance with the principles of the invention. The noise estimatorincludes three main blocks, an optional short-term maximum hold filter301, a pseudo minimum rise (PMR) filter 312, and an aliasing filter 311.Two parallel-connected DR filters are employed; namely, a masterdelayed-rise filter 303 and a slave delayed-rise filter 305. Theconfiguration of FIG. 4 may be applied in the time domain or in thefrequency domain. Accordingly, the input to the system of FIG. 4 dependsupon whether frequency-domain or time-domain operation is contemplated.For frequency domain operation, this input is in the form of samplesrepresenting spectral magnitudes. For time domain operation, the inputis in the form of samples representing short term average (or RMS)values of a signal. These short-term average values may be determinedonly on a periodic basis; that is, for example, every 5 ms, such thatthe noise estimator is running at a lower sampling rate (e.g. 1/5 ms=200Hz). The same is true for a corresponding frequency domainimplementation, where a Fast Fourier Transform (FFT) may be performedevery 5 ms. In the time-domain version, the optional short-termmaximum-hold filter 301 could be eliminated at the expense of apotential loss in performance. However, if this filter is, indeed,eliminated, the short-term average needs to be calculated at least overseveral milliseconds, say 20 ms, which represents the minimum durationof a phonemic minima.

In the example of FIG. 4, samples are fed to a maximum-hold filter 301.As stated above in connection with FIG. 2, a maximum-hold filter 301 oflength L holds the maximum sample value from a sample set of L samples.This filter eliminates low-level “outlying” samples so as to address thepossibility that noise and speech can momentarily cancel out each otherif they are of similar magnitudes but opposite in phase. Suchcancellation could occur over one frequency band, across severalfrequency bands, or even throughout the entire frequency band of thesignal. Ideally, the composite magnitude, i.e., the magnitude of speechplus noise, is only evaluated when both noise and speech are in phase,at which instance the composite magnitude reaches its maximum.Consequently, short-term maxima are most relevant. The short-termmaximum-hold filter ensures that the noise component is only trackedduring true phonemic minima. Since phonemic minima typically last longerthan 20 ms, the time-constant of the maximum-hold filter is set toτ_(L)≈20 ms. Accordingly, the maximum hold filter 301 prevents minimashorter than 20 ms from reaching the input of pseudo minimum rise (PMR)filter 312. It should be noted that, in general, a short-term maximumhold filter provides considerable computational expediency over theprior art short-term smoothing filter. For this reason, a true maximumhold filter 301 can be employed in FIG. 4 without adding muchcomplexity.

Assuming that the sequence v(i) is sampled at a sampling frequency ƒv·,then the required length L of maximum-hold filter 301 is determined byL=τhd L·ƒv ·For a typical sampling frequency ƒv of 200 Hz, corresponding to a blocklength of 5 ms, the required length L of the filter is 4. This providesa filter of relatively small size, resulting in a small computationalload. It may be noted that, instead of using a maximum-hold filter 301in the configuration of FIG. 4, any of a number of other filters couldbe employed to achieve the purpose of blocking out short minima. Amedian filter provides performance very similar to that of themaximum-hold filter, at the expense of higher computational complexity.A lowpass (short-term smoothing) filter, as used in the prior art,although computationally the least intensive, provides degradedperformance since such a filter does not satisfy the design criteriadiscussed above (i.e., substantially filtering out short minima). Alsonote that the maximum-hold filter is preferred over an ordinaryexponentially decaying peak-tracker realized by a first order recursivefilter since such a filter does not have a finite impulse response.

The output of maximum-hold filter 301 is fed to both master and slavedelayed-rise filters 303, 305, respectively. The master and slavedelayed-rise filters 303, 305 are characterized by a minimum hold time,τ_(M), representing the minimum amount of time that the filter outputwill be held at a given value, and also by a rise time, τ_(R),representing the amount of time required for a 20-dB increase in themagnitude of the estimated noise. Note that an illustrative hardwareblock diagram for a DR filter was shown in FIG. 3.

A comparator 307 successively compares the output magnitude of themaster delayed-rise filter 303 with that of the slave delayed-risefilter 305, and controls a switch 309 so as to select the filter outputhaving the lowest magnitude output sample. An optional aliasing filter311 may be used to suppress estimated noise components which, from atheoretical point of view, should not exist and which could representremaining speech components. The components within the dashed linesrepresent a PMR filter 312.

From a qualitative standpoint, the configuration of FIG. 4 avoidsfollowing a speech signal when estimating noise. The master and slave DRfilters 303, 305 define the maximum allowable rise of the estimatedsignal per unit time. This determines how fast the DR filter can tracknoise. The DR filters are based upon the assumption that noise does notchange as rapidly as speech, and this assumption is valid for most typesof noise. For this reason, it is difficult or impossible to estimate anupward noise transient in which the noise level increases too abruptly.However, a downward transient, i.e., a decreasing noise level can betracked much faster, since the adaptation to lower noise estimates isonly limited by the maximum-hold filter 301.

It would be possible to achieve great accuracy in estimating noise ifthe configuration of FIG. 4 were to include M parallel-connected DRfilters instead of only a master DR filter 303 and a slave DR filter305, M representing the number of samples in a sample set. However, if MDR filters were employed, selecting the lowest-magnitude output valuefrom among a total of M parallel-connected DR filters would require acomparator 307 that implements a minimum operator of order M.Accordingly, this technique for determining minimum sample values wouldnot provide reduced computational complexity over the prior art methoddescribed above. However, by relaxing the upper bound, it is possible tocompromise accuracy for complexity. Best performance is achieved with alow upper bound, whereas the lowest complexity is achieved by using theleast number of parallel-connected DR filters.

In analyzing the relationship between complexity and accuracy, aconfiguration using N DR filters in parallel, combined with amin-operator of order N, will be referred to as an Nth order PMR (pseudoMR) filter. For an Nth order PMR filter, the output is limited bymin(x(i),x(i−1), . . . , x(i−M+1)≦y(i)≦min(x(i),x(i−1), . . . ,x(i−N−1·M))assuming that, for every MIN sampling cycle, one of the DR filters isreset. It is observed that, if N=M, the preceding equation reduces tomin(x(i), xi−1), . . . ,x(i−M+1))=y(i) . . .that is, using M parallel-connected filters, the performance of a trueminimum-hold filter is achieved, as noted previously. If N=1, thepreceding equation reduces to:min(x(i), xi−1), . . . x(i−M+1))≦y(i)≦x(i).

The noise estimator of FIG. 4 approximates the performance of a true PMTnoise estimator by using a 2^(nd) order PMR filter. In this example, the2^(nd) order min-operator is effectively implemented using comparator307, which selects the better-performing filter output (lower output)out of the master DR filter 303 and the slave DR filter 305.

FIG. 5 is a flowchart setting forth the sequence of operations performedby the filter design of FIG. 4. The program commences at block 401 wherea minimum hold counter of a master DR filter, denoted as C_(M), aminimum hold counter of a slave DR filter, denoted as C_(S), a noiseestimate from the master DR filter, denoted as Y_(M), and a noiseestimate from the slave DR filter, denoted as Y_(S), are allinitialized. Next, at block 403, a new sample input value (X) is read. Atest is performed at block 405 to ascertain whether or not Y_(M) is lessthan a noise start level E. If so, then Y_(M) is set to E (block 409),and C_(M) is set to M, where M denotes a minimum hold constant (block411). The program then continues at block 434.

The negative branch from block 405 leads to block 407 where a test isperformed to determine whether or not X is greater than Y_(M). If not,the master delayed-rise (DR) filter is restarted by setting Y_(M) to Xand by setting C_(M) to zero (block 415), and the program continues atblock 434. The affirmative branch from block 407 leads to block 417where it is determined whether or not C_(M) is greater than M. If C_(M)is greater than M, then Y_(M) is set to the product of r times Y_(M),where r is a rise time constant (block 421), and the program continuesat block 434. If C_(M) is not greater than M, C_(M) is set to C_(M) +1and the program continues at block 423.

The operations of block 423 are performed after C_(M) is set to C_(M) +1in block 419. At block 423, a test is performed to ascertain whether ornot C_(M) is equal to M/2. If so, the program progresses to block 428where the slave delayed-rise filter is restarted by setting Y_(S)=X, andby setting C_(S) to zero. The program then advances to block 434.

Block 434 may be reached from block 415, block 421, or block 411, aswell as from block 423. At block 434, a test is performed to determinewhether or not C_(S) is less than or equal to M, and Y_(S), is less thanX. If both of these conditions are met, the program advances to block427 where the slave delayed-rise filter is updated by setting C_(s) toC_(S)+1, and the program continues on to block 429. If one or both ofthe conditions of block 434 are not met, the program goes to block 425,where the delayed-rise filter is restarted by setting Y_(S) to X, and bysetting C_(S) to zero. The program then advances to block 429.

At block 429, a test is performed to determine whether or not Y_(S) isless than Y_(M). If so, the values of Y_(M) and Y_(S) are swapped, thevalues of C_(M) and C_(S) are also swapped (block 431), and the programcontinues to block 433. The negative branch from block 429 also leads toblock 433, where Y_(M) is used as the noise estimate. The program thenloops back to block 403.

FIG. 6 is a hardware block diagram showing an illustrative embodiment ofa noise estimator using a respective PMR filter for each of acorresponding plurality of frequency bands. By way of background, anumber of techniques exist for processing a signal in the frequencydomain. A commonly utilized technique is called “overlap-add”, whereindividual signal blocks are overlapped and added to construct orsynthesize a signal. FIG. 6 shows a novel system for processing thesesignal blocks in the operational environment of “overlap-add”. Block 501calculates the Fourier transform, which provides the spectrum of thesignal in form of real and imaginary parts, denoted as Re[V] and Im[V].Real and imaginary part are transformed into spectral magnitude |V| andspectral phase arg[V] (block 503). Each individual frequency magnitudeis connected to a PPMT filter (blocks 507, 509, . . . , 511). The outputsignals from the PPMT filters provide the estimate for the spectralmagnitude of the noise IM. For many application, such as spectral noisereduction, a spectral representation of the noise estimate will suffice,and such a representation is developed by adding the outputs of blocks507, 509, . . . , 511. For applications where an estimate for the noisesignal is desired, the spectral noise estimate and the phase arg[V] ofthe original signal is fed to block 513, which transforms magnitude andphase to real and imaginary parts. Finally, block 515 performs aninverse Fourier transform and provides the estimated noise signal.

By splitting the signal into a plurality of frequency bands as shown inFIG. 6, the resulting noise estimate is considerably more accurate thanthe noise estimate obtained from a full-band noise estimator thatprocesses the entire frequency band as a single entity. The reason forthe increased performance of a frequency-domain noise estimator is dueto the frequency dependence of phonemic minima. Assume a phonemicminimum occurs at low audio frequencies (e.g., produced by an unvoiced/s/) followed by a phonemic minimum at high audio frequencies (e.g.,produced by a voiced /o/). These minima appear very clearly in therespective individual audio frequency bands. If full-band processing isemployed instead of split-band processing, minima which occur at highaudio frequencies are likely to disappear since they may be masked bylow audio frequency components of the voice signal occurring at the sametime. On the other hand, minima at low audio frequencies are often stillpresent in the time domain (full-band) signal. In view of phonemes, atime-domain noise estimator relies mainly on low-level unvoicedconsonants, which produce only quasi-minima. These quasi-minima onlyhelp to identify noise above the level of these low-level consonants. Ifthe noise level is below the level of these consonants, then shortpauses before explosive consonants and true speech pauses could be usedfor estimating the noise level. However, if information acquired duringthese pauses is used to estimate the noise level, the time constant ofthe minimum-hold filter must be increased.

Several advantages arise from using a frequency-domain noise estimator,an illustrative example of which is shown in FIG. 6, versus atime-domain (full-band) noise estimator. These advantages include afaster adaptation to noise, an increased dynamic range within whichnoise can be estimated, and the utilization of information regarding thespectral properties of the noise. However, a time-domain noise estimatorprovides greater simplicity than a frequency-domain noise estimator. Fora given system application, the advantages of the frequency-domainapproach may be weighed against the simplicity of the time-domaintechnique.

FIG. 7 is a hardware block diagram of an illustrative full-bandimplementation of the noise estimator constructed according to theinvention. A noisy speech signal is fed to a short-term averaging filter601, which performs a short-term average calculation. The output ofshort-term averaging filter 601 is connected to an optional short-termmaximum hold filter 602. Although the short-term maximum hold filter 602is optional, its elimination may result in a performance loss. Moreover,if this short-term maximum hold filter is eliminated, the short-termaverage needs to be calculated at least over several milliseconds, say20 ms, in order to smooth out short minima that are not originating fromphonemic speech minima. The output of short-term maximum hold filter 602is fed to a PMR filter 603, the structure and function of which havebeen previously described. An optional aliasing filter 604 may beemployed to filter the output of PMR filter 603.

To provide a deeper analysis of the phonemic minima tracking noiseestimator, a detailed discussion of FIG. 2 follows. As stated above, theduration of phonemic minima, as well as the duration between twoconsecutive minima, may be used to discriminate speech from noise. Theshort-term maximum-hold filter 701 is designed to implement the first ofthese discrimination features. More specifically, maximum-hold filter701 discards short minima having a duration less than τ_(L) . Theseshort minima are discarded because they do not represent speech, butrather are a result of the phase relationship between speech and noise.The maximum-hold filter is designed to substantially eliminate theserapid minima, while at the same time preserving the characteristic,long-lasting minima of the speech spectral magnitude components, alsotermed phonemic minima.

The long-term minimum-hold filter 703 exploits the second discriminationfeature, that is, the distance between successive phonemic minima inspeech within a single spectral component. Assume that the noise remainsstationary over a time period of more than τ_(M.) Within this timeperiod, the speech is likely to encounter a phonemic minima, in whichcase, the speech component of the composite (speech plus noise) sampleclosely approaches zero. Therefore, the noise becomes accessible duringphonemic minima. To take advantage of this situation, a long-termminimum-hold filter 703 is employed which determines the minimum withina given time period τ_(M).

Rise time limitation filter 705 is designed to prevent the system fromfollowing any remaining speech spurts at the output of long-term minimumhold filter 703. Rise-time limitation filter 705 may be implementedusing the components enclosed within the dashed lines of FIG. 1 anddescribed above as the rise-time-limitation filter. Conceptually,rise-time limitation filter 705 controls adaptation to noise, such thatthe noise estimate may increase only a pre-defined number of dBs persecond, until the noise estimate reaches the level of a spectralminimum. In other words, rise time filter places a limit on the maximumallowable rise of its output signal per unit of time. This adaptationproperty is most apparent in cases where the onset of noise is rathersudden. Such a level-independent filter that limits the rise time of theoutput signal has properties that are mathematically denoted as${y(i)} = \{ \begin{matrix}{{r \cdot {y( {i - 1} )}};} & {{{if}\quad E} < {r \cdot {y( {i - 1} )}} < {x(i)}} \\{E;} & {{{if}\quad{r \cdot {y( {i - 1} )}}} < E} \\{{x(i)};} & {else}\end{matrix} $where x(i) is the input, y(i) the output, E the noise start level, andr>1 the rise-time coefficient. The rise-time may be specified as thetime required for a 20 dB increase of the noise estimate. For a givenrise-time TR the rise-time constant r can be calculated by ther=¹ ^(/ƒv) ^(τR)where ƒv denotes the sampling frequency of the sequence x(i). Rise-timeτ_(R) may be set to a duration on the order of several hundredmilliseconds. The rise-time limitation filter controls the attack timeof the noise estimator to prevent sudden large increments of the noiseestimate and instead provides a gradually increasing noise estimate.Consecutive multiplication with the rise-time constant results in alogarithmic increase of the noise estimate, that is, a fixed number ofdBs per second. Rise-time constant r is set slightly greater than one.The more this constant approaches one, the smaller the increase of thenoise estimate per time and the larger the rise-time. Note thatminimum-hold filter 703 and rise-time limitation filter 705 affects onlythe positive slope of the noise estimate (attack), while the short-termmaximum-hold filter 701 affects only the negative slope of the noiseestimate (release).

Aliasing filter 707 is employed to implement the second discriminationfeature mentioned above. According to sampling theory, one can onlyestimate noise up to frequencyƒ_(m)=½±1/τ_(M) assuming a samplingfrequency of 1/τ_(M). Hence, estimates for frequencies above ƒ_(m) carryno valid information. These frequency components are removed by thealiasing filter 707. The filter coefficients of the aliasing filter 707may be scaled to adjust for a potential bias. However, unlike theprevious art TTP noise estimator, scaling the aliasing filter is not aninherent part of the PMT noise estimator.

The PMT noise estimator of FIG. 2 utilizes the two discriminationfeatures mentioned above; namely, the duration of phonemic minima andthe duration between two consecutive minima, which are described interms of time constants τ_(L) and τ_(M). An additional time parameter,τ_(R), the rise time limitation constant, controls the adaptation of thenoise estimate. The PMT noise estimator estimates the noise spectralmagnitude not only during speech pauses, but also during speechactivity. Performing noise estimation continuously over non-speechsegments, as well as over speech segments, circumvents the need for aspeech-activity detector. Therefore, the PMT noise estimator does notrely on a speech-activity detector, the performance of which usuallydeteriorates rapidly with an increasing noise level. For a non-disturbedspeech signal, the PMT noise estimator tracks the phonemic minima. Ifthe speech is disturbed by noise, the phonemic minima are filled up withnoise and the noise is tracked instead.

The PMT noise estimator is based upon an observation that noise can beestimated more accurately if the noise parameters are estimatedconstantly; that is, during periods of no speech activity and alsoduring periods of speech. More importantly, however, the techniqueadvantageously exploits the fact that there is a difference between thestationarity characteristics of the desired signal and the stationaritycharacteristics of noise.

In many applications, noise parameters, such as the auto-correlationcoefficients of the noise, are stationary over a longer period of timethan corresponding parameters of the desired signal. Auto-correlationcoefficients having relatively long periods of stationarity (as comparedto other autocorrelation coefficients) are presumed to represent noise,and, as such, the PMT noise estimator uses this fact to calculate anestimate of the noise signal. For example, consider a noisy speechsignal originating from a car's cellular phone. The speech signal istypically stationary over a time period of about 20 to 200 ms, whilenoise within the passenger compartment of the car can often berepresented as a stationary sequence of parameters having a durationmuch longer than 200 ms. Therefore, parameters which remain relativelyconstant for a time duration of longer than 200 ms may be presumed tocharacterize the noise portion of a signal, whereas parameters whichexhibit substantial changes within a time interval of less than 200 mslikely characterize the voice portion of the signal.

The techniques of the first embodiment of the invention take intoaccount a realization that, in speech, the duration of spectral minima,as well as the distance between consecutive spectral minima within aspectral component, are parameters that generally fall within acharacteristic range of values. Spectral minima during speech activityare caused by the phonemic structure in speech, such as an alternatingoccurrence of voiced and unvoiced phonemes. Accordingly, these minimamay be referred to as spectral phonemic minima, or, to be more concise,phonemic minima. Phonemic minima occur in the presence of a number ofphonemes as shown in Table 1. TABLE 1 Phonemes that Produce PhonemicMinima Phonemes Description Unvoiced stop constants These constants arepreceded by /p/, /t/, /k/ short pauses as the lips are pressed togetherto build up the air for the formation of the sound. The average durationof these pauses is about 50 ms. Unvoiced fricatives For these phonemes,low frequency /f/, /θ/, /s/, /sch/ audio components are stronglyreduced. Voiced vowels For these dark-sounding vowels, /u/, /o/ highfrequency audio components are reduced. Voiced phonemes In thesephonemes, the valleys between formant poles reach low values. Highpitched voiced phonemes In these phonemes, the valleys between harmonicsof the pitch frequency reach low values.The duration of spectral minima and the duration between two consecutivespectral minima may be used to discriminate speech from noise. Forspeech, a first discrimination feature can be defined as the duration ofphonemic minima, characterized by a time period of τ_(p). The lowerbound of τ_(p) is given by the minimum duration of a pause before anunvoiced stop consonant. The upper bound of τ_(p) is given by themaximum duration of a phoneme. Minima of duration τ_(p) in a compositesignal in stationarity are therefore attributed to speech. Thesephonemic minima allow access to the noise spectrum at the variable rateof their occurrence. The rate at which these minima occur constitutes asecond discrimination feature. The corresponding duration between twoconsecutive phonemic minima is denoted by a time constant τ_(m). Thenoise is assumed to be stationary between two consecutive phonemicminima, and this assumption is valid for near-stationary noise.

The PMT noise estimator described above can be applied to estimatenear-stationary and stationary noise.

Acronyms Used in Text:

Filters:

-   DR Delayed Rise-   MR Minimum Rise (Minimum-hold followed by Rise-time limitation    filter)-   PMR Pseudo Minimum Rise-   Noise Estimators:-   PMT Phonemic Minima Tracking-   PPMT Pseudo Phonemic Minima Tracking-   TTP Two Time Parameter

1-23. (canceled)
 24. An apparatus comprising: prefiltering means forprefiltering a sample set during periods of no speech activity andduring periods of speech activity and prior to noise estimation of asignal, the prefiltering means discarding spectral minima in the sampleset that are shorter than a specified duration so as to provide a set ofsamples prefiltered both during periods of no speech activity and duringspeech activity for noise estimation, wherein the sample set includeseither samples representing spectral magnitudes of the signal or samplesrepresenting short term average magnitude values of the signal.
 25. Theapparatus as in claim 24 wherein the sample set includes either samplesrepresenting spectral magnitudes of the signal or samples representingshort term average magnitude values of the signal.
 26. The apparatus ofclaim 24 wherein the prefiltering means includes means for holding amaximum sample value from a sample set for a specified duration.
 27. Theapparatus of claim 26 wherein the prefiltering means includes ashort-term maximum hold filter.
 28. An apparatus for estimating thenoise component of a sampled signal comprising: (a) prefiltering meansfor prefiltering a sample set during periods of no speech activity andduring periods of speech activity and prior to noise estimation of asignal, the prefiltering means discarding spectral minima in the sampleset that are shorter than a specified duration so as to provide a set ofsamples prefiltered both during periods of no speech activity and duringspeech activity for noise estimation, wherein the sample set includeseither samples representing spectral magnitudes of the signal or samplesrepresenting short term average magnitude values of the signal; (b) aplurality of filtering means each providing an estimate of a minimumsample in the sample set; and (c) comparing means, coupled to theplurality of filtering means, for successively comparing estimates amongthe plurality of filtering means, and selecting the signal estimatehaving the lowest magnitude as a noise component estimate.